APPARATUS AND METHOD FOR DISPLAYING THREE-DIMENSIONAL IMAGE 


BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to an apparatus and method 
for displaying a three-dimensional image in real time. 

2 . Description of the Related Art 

Recently, a three-dimensional image processing technology 
is used in various fields such as education, training, medical 
treatment, and computer games. The three-dimensional image is 
more useful than a two-dimensional image in that it has presence 
feeling, real feeling, and natural feeling. 

Many researches for implementing such a three-dimensional 
image display are currently in progress. 

The three-dimensional image display requires various 
technologies such as input technology, processing technology, 
transmission technology, display technology, and software 
technology. Particularly, it essentially requires researches for 
the display technology, digital image processing technology, 
computer graphic technology, and human visual system. 

The most fundamental method of the three-dimensional image 
display is based on glasses. As typical examples, there are a 
color separation mode, a polarized glasses mode, and a liquid 


crystal shutter mode. The color separation mode permits a viewer 
to observe images through color glasses using different light 
wavelengths. The polarized glasses mode is based on different 
light oscillation directions. The liquid crystal shutter mode 

5 permits a viewer to observe left and right images by temporally 
dividing the images. 

The glasses-based three-dimensional image display method 

O provides picture quality of high definition but has two drawbacks. 

Bl The one drawback arises from inconvenience caused by wearing 

1W glasses and the other drawback arises in that only scenographic 

O 

*%l feeling exists in a fixed visual point. For these reasons, 

^ researches for direct three-dimensional image display without 

!~f wearing glasses are currently in progress. 
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m The direct three-dimensional image display separates left 

15 and right images without using glasses, especially separates 
images corresponding to left and right eyes in a particular 
observation position using a parallax barrier, a lenticular plate, 
or a fly eye lens plate. 

Particularly, an integral photography mode is well known. 
20 This integral photography mode records, transmits, and 
regenerates three-dimensional images formed by a fly eye shaped 
microlens array. 

In more detail, as shown in Fig. 1, a microlens array 10 
having fly eye shaped microlens arrays 11 is arranged, and a 
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number of microimages 13 of a subject entered through each 
microlens 11 are recorded on a printing paper in a microimage 
focus surface 12. 

If light is illuminated at the rear of the printing paper, 

5 respective microimages 13 recorded on the printing paper progress 
in the same path as when the subject is taken, so that a three- 
dimensional image 14 is regenerated in an original subject 

□ position, 

Co However, a comfortable viewing zone that can observe the 

'in 

! b? 5 

1Q| regenerated three-dimensional image is limited to a boundary of 

=F the three-dimensional image 14. 

!i b For example, a viewing angle of a two-dimensional display 

rL-.il 

based on a cathode ray tube (CRT), a plasma display panel (PDP) , 
!pj and a liquid crystal display (LCD) is approximate to 120W but a 

15 viewing angle of a three-dimensional display such as an integral 
photography is about 20° or less. 

Figs. 2a and 2b show three-dimensional images observed in a 
zone other than inside and outside of a viewing angle of an 
apparatus, for displaying a three-dimensional image. 

20 As shown in Fig. 2a, two-dimensional microimages are 

provided on a screen 22. The microimages are synthesized to a 
three-dimensional image 23 through a microlens array 21 and then 
regenerated. At this time, an observer 24 located within a 
boundary 25 of a main viewing zone 26, i.e., within a viewing 
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angle of the apparatus for displaying a three-dimensional image 
can observe the regenerated three-dimensional image 23. 

The viewing angle 2co that can observe the regenerated 
three-dimensional image 23 is. limited to the boundary of the 
three-dimensional image . 

As shown in Fig. 2b, if an observer 27 moves out of the 
main viewing zone 26 marked by dotted lines, he is entering into 
a satellite viewing zone 29 remarked by solid lines. 

The observer 27 observes a satellite image 28 in the 
satellite viewing zone 29. The satellite image 28 is observed 
within the viewing angle 2co, as shown in Fig. 2a. 

The satellite image 28 observed in the satellite viewing 
zone 29 is similar to the image 23 observed in the main viewing 
zone of Fig. 2a. However, the satellite image 28 has a seriously 
distorted three-dimensional image. This is because that an angle 
between vertical and horizontal directions in the regenerated 
satellite image 28 is different from an angle of the regenerated 
image 23 of Fig. 2a. 

As described above, the related art apparatus for 
displaying a three-dimensional image has a problem in that the 
viewing angle that can stably observe a three-dimensional image 
is narrow. For this reason, another problem arises in that the 
apparatus for displaying a three-dimensional image is limited in 
its use range. 


SUMMARY OF THE INVENTION 

To solve the above problems, an object of the present 
invention is to provide an apparatus and method for displaying a 
three-dimensional image in real time, in which a three- 
dimensional image having no distortion out of a viewing zone can 
stably be observed. 

To achieve the above object, an apparatus for displaying a 
three-dimensional image according to the present invention, which 
synthesizes two-dimensional microimages and regenerates them in a 
three-dimensional image, includes a detector for tracing movement 
of an observer head that observes the three-dimensional image, in 
real time and detecting the position of the observer head, and a 
compensator for adjusting a viewing zone of the three-dimensional 
image and/or compensating distortion of the three-dimensional 
image in accordance with a signal input from the detector. 

The detector includes a head tracking system which traces 
movement of the observer head in real time, and a head position 
detector for calculating the position of the observer head traced 
by the head tracking system. The compensator includes either a 
viewing zone adjust engine which adjusts the viewing zone of the 
three-dimensional image by moving the microimages in accordance 
with a signal input from the head position detector, or an 
aspectogram regeneration engine which compensates distortion of 


the three-dimensional image by regenerating the microimages in 
accordance with the signal input from the head position detector. 

To further achieve the above object, an apparatus for 
displaying a three-dimensional image according to the present 

5 invention includes an aspectogram containing a plurality of two- 
dimensional microimages displayed in real time, a microlens array 
for synthesizing the two-dimensional microimages and regenerating 

Q them in a three-dimensional image, a head tracking system for 

Q! tracing movement of an observer head that observes the three- 
ill 

10J dimensional image, in real time, a head position detector for 

IT 0 ! 5 

'S3? 

4» calculating the position of the observer head traced by the head 

^ tracking system, and a viewing adjust engine for adjusting a 

- 1 - 

ft viewing zone of the three-dimensional image by moving the 
!!* microimages in accordance with a signal input from the head 
lS" position detector. 

The apparatus further includes an aspectogram regeneration 
engine which regenerates the microimages in accordance with the 
signal input from the head position detector to compensate 
distortion of the three-dimensional image. Also, the regenerated 
20 microimages are moved to form a viewing zone centered relative to 
the observer head by the viewing adjust engine. 

To further achieve the above object, an apparatus for 
displaying a three-dimensional image according to the present 
invention includes an aspectogram containing a plurality of two- 


dimensional microimages displayed in real time, a microlens array 
for synthesizing the two-dimensional microimages and regenerating 
them in a three-dimensional image, a head tracking system for 
tracing movement of an observer head that observes the three- 

5 dimensional image, in real time, a head position detector for 
calculating the position of the observer head traced by the head 
tracking system, and an aspectogram regeneration engine for 

□ regenerating the microimages in accordance with a signal input 

Sj from the head position detector to compensate distortion of the 
l&l three-dimensional image. 

|; The apparatus further includes a viewing adjust engine 

which adjusts a viewing zone of the three-dimensional image by 

i! t% 

"f* moving the regenerated microimages to form the viewing zone 
centered relative to the observer head in accordance with a 

l!T signal input from the head position detector and the aspectogram 
regeneration engine. 

To further achieve the above object, a method for 
displaying a three-dimensional image according to the present 
invention, which synthesizes two-dimensional microimages and 

20 regenerates them in a three-dimensional image, includes the steps 
of tracing movement of an observer head that observes the three- 
dimensional image, in real time, calculating the position of the 
traced observer head, and adjusting a viewing zone of the three- 
dimensional image and/or compensating distortion of the three- 


dimensional image, in accordance with the calculated position of 
the observer head. 

The step of adjusting the viewing zone of the three- 
dimensional image includes the step of moving the main viewing 
zone to be centered relative to the observer head by moving the 
two-dimensional microimages. The step of compensating distortion 
of the three-dimensional image includes the step of regenerating 
the two-dimensional microimages. 

In the operation of the apparatus for displaying a three- 
dimensional image, if the observer head moves out of the viewing 
zone, the head tracking system traces movement of the observer 
head and transmits a resultant signal to the aspectogram 
regeneration engine and the viewing adjust engine. The 
aspectogram regeneration engine regenerates the microimages so as 
not to be distorted even in the position of the moved observer 
head. The viewing adjust engine moves the regenerated microimages 
to form the viewing zone centered relative to the observer head 
so that the three-dimensional image having no distortion can be 
observed from an arbitrary head position, thereby obtaining a 
wide and comfortable viewing angle. 

It is to be understood that both the foregoing general 
description and the following detailed description are exemplary 
and explanatory and are intended to provide further explanation 
of the invention as claimed. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Other objects, characteristic features and advantages of 
the present invention will now become apparent with a detailed 
description of an embodiment made with reference to the 
accompanying drawings, in which: 

Fig. 1 shows a method for displaying a general three- 
dimensional image ; 

Fig. 2 shows three-dimensional images regenerated in 
accordance with movement of an observer head in a related art 
apparatus for displaying a three-dimensional image; and 

Figs. 3 to 5 show apparatuses for displaying a three- 
dimensional image according to the first to third embodiments of 
the present invention. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

The following is a detailed description of a preferred 
embodiment of an apparatus and method for displaying a three- 
dimensional image according to the present invention made with 
reference to the accompanying drawings. 

Fig. 3 shows an apparatus for displaying a three- 
dimensional image according to the first embodiment of the 
present invention . 

As shown in Fig. 3, an aspectogram containing two- 


dimensional microimages is provided on a screen 32. The 
microimages are synthesized to a three-dimensional image 39 
through a microlens array 31 and then regenerated. At this time, 
the apparatus for displaying a three-dimensional image according 
to the first embodiment of the present invention further includes 
a head tracking system 33, a head position detector 34, and a 
viewing adjust engine 35, unlike the related art. 

The head tracking system 33 traces movement of an observer 
head that acts to observe the three-dimensional image, in real 
time. The head position detector 34 calculates the position of 
the observer head traced by the head tracking system 33. The 
viewing adjust engine 35 moves the microimages to form a new 
viewing zone centered relative to the observer head in accordance 
with a signal input from the head position detector 34, so that 
the viewing zone of the three-dimensional image is adjusted. 

The operation of the apparatus for displaying a three- 
dimensional image according to the first embodiment of the 
present invention will now be described. 

If the observer head 40 moves from the center of a main 
viewing zone to a boundary 38 of the main viewing zone, the head 
tracking system 33 traces movement of the observer head and 
transmits a resultant signal to the head position detector 34. 

The head position detector 34 calculates the position of 
the observer head in accordance with the signal of the head 
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tracking system 33, and then transmits the calculated signal to 
the viewing adjust engine 35. 

The viewing adjust engine 35 moves the microimages 
displayed on the screen 32 in accordance with an input signal so 
5 that the viewing zone is adjusted to correspond to the position 
of a new observer head 40. 

A new viewing zone arising from movement of the observer 
Cl head 40 is shown in dotted lines 41. 

P? The method for adjusting the viewing zone according to the 

h n 

first embodiment of the present invention provides a viewing zone 

Cl 

^ that can stably observe a three-dimensional image even if the 

t. t observer head 4 0 moves. However, in this method, a three- 

r\" dimensional image 42 having some distortion is still observed. 

^ Fig. 4 shows an apparatus for displaying a three- 

Is-* 

15 dimensional image according to the second embodiment of the 
present invention. In the second embodiment of the present 
invention, instead of the viewing adjust engine 35, an 
aspectogram regeneration engine 36 is additionally provided. The 
aspectogram regeneration engine 36 regenerates the aspectograms 

20 in accordance with a signal input from the head position detector 
34 to compensate distortion of the three-dimensional image. 

The operation of the apparatus for displaying a three- 
dimensional image according to the second embodiment of the 
present invention will now be described. 


If an observer head 43 departs from a boundary 38 of a 
limited main viewing zone 38 and moves to a boundary 44 of a 
satellite viewing zone, the head tracking system 33 detects 
movement of the observer head in real time and transmits a 
resultant signal to the head position detector 34. 

The head position detector 34 calculates the position of 
the observer head in accordance with the signal of the head 
tracking system 33, and then transmits the calculated signal to 

S! the aspectogram regeneration engine 36. 

HI 

lM The aspectogram regeneration engine 36 regenerates the 

sr— It 

4* microimages displayed on the screen 32 in accordance with the 
input signal in new microimages of which distortion is 
compensated. 

il- As described above, the observer can observe a three- 

15 dimensional image having no distortion even in a satellite 
viewing zone other than a main viewing zone due to regeneration 
of the microimages of which distortion is compensated. 

However, since the viewing zone that can stably observe the 
three-dimensional image in accordance with movement of the 
20 observer is not provided, it is likely that the three-dimensional 
image is biased to one direction. 

Fig. 5 shows an apparatus for displaying a three- 
dimensional image according to the third embodiment of the 
present invention. In the third embodiment of the present 
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invention, both the viewing adjust engine 35 of the first 
embodiment and the aspectogram regeneration engine 36 of the 
second embodiment are additionally provided. 

As shown in Fig. 5, an observer 37 observes a three- 
dimensional image 39 displayed by synthesizing the two- 
dimensional microimages provided on the screen 32 through the 
microlens array 31. 

If the observer head 37 is within the main viewing zone, no 
signal occurs in the head position detector 41- However, if the 
observer head 4 6 moves to either the boundary of the main viewing 
zone or out of the boundary, the head tracking system 33 directly 
traces movement of the observer head and transmits a resultant 
signal to the head position detector 34. 

The head position detector 34 calculates the position of 
the observer head in accordance with the signal of the head 
tracking system 33, and then transmits the calculated signal to 
both the aspectogram regeneration engine 36 and the viewing 
adjust engine 35. 

The aspectogram regeneration engine 36 regenerates the two- 
dimensional microimages displayed on the screen 32 in accordance 
with the input signal in new microimages of which distortion is 
compensated. The viewing adjust engine 35 adjusts the viewing 
zone to correspond to the position of a new observer head 4 6 by 
moving the new microimages displayed on the screen 32 in 
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accordance with the input signal and of which distortion is 
compensated. 

In the third embodiment which is the most preferred 
embodiment of the present invention, comfortable three- 
dimensional image having a wide viewing angle without distortion 
can be observed. 

The apparatus for displaying a three-dimensional image 
p according to the present invention is applicable to the 
microimages of all display devices such as an LCD, a PDP, a CRT, 


1W and a screen having a projection system. 

As aforementioned, the apparatus and method for displaying 
JL 4 a three-dimensional image according to the present invention has 

;"■ ¥% 

f." the following advantages. 

L= % Since the three-dimensional image having no distortion is 

15 provided even if the observer head moves out of the main viewing 
zone, a wide viewing angle can be obtained. 

The above description will enable one skilled in the art to 
modify and revise the invention within the spirit not degrading 
the technical concept of the present invention. However, the 
20 technical scope of the present invention is not limited to the 
above description of the embodiment but shall be determined by 
the claims. 
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